Amendments to the Specification: 

[0014] In one embodiment of the invention, a method includes (1) generating a first image pyramid 
of a first image, (2) generating a second image pyramid of a second image, (3) warping a first level 
image of the first image pyramid with a motion field, ( 4 ) determining a residual motion field from the 
warped first level imago of the first imago pyramid and a corresponding first level imago of the 
second image pyramid, and (5) if the residual motion field is not less than a threshold, adding the 
residual motion field to the motion field and repeating steps (3) and (A). In one embodiment, a 
method for processing motion frames comprises providing a first image pyramid associated with a 
first image and a second image pyramid associated with a second image, wherein the first and second 
image pyramids respectively comprise a plurality of corresponding image levels of gradual 
resolutions, computing a motion field comprising a plurality of motion vectors that respectively 
associate each pixel in the first image with a corresponding pixel in the second image, wherein the 
motion field is computed recursively through the image levels from a coarsest resolution to a finest 
resolution, and generating an intermediate image between the first image and the second image on a 
pixcl-by-pixcl basis using the motion field. 

[0015] In accordance with the invention, a robust and accurate motion compensated temporal 
interpolation (MCTI) technique is applied in slow motion processing of digital video data to construct 
new intermediate frames with considerable less artifacts. As shown in Fig. 1, the slow motion 
processing 10 is divided into two stages: motion estimation and motion compensation. An accurate 
and dense motion field can be determined from each pair of consecutive frames in the original 
sequence. With the motion field, pixels in the original frame can be moved to appropriate locations 
along the motion trajectories to form pixels of a new intermediate frame. The new slow motion 
processed video is then formed by inserting the new intermediate frames between the original frames. 

[0019] Fig. 2 illustrates an image pyramid 30 having a number of i max +1 (e.g., 3) number of levels in 
one embodiment. The motion estimation begins at the highest level Z- ! ™° , where a coarse motion field 
d lm " is obtained using an iterative motion estimator. The iterative motion estimation algorithm is 
detailed in the next section. The coarse motion field d' max is then propagated to the next finer level 
Z><=~ ; m as an initial guess for the motion field in the iterative motion estimation at level Z, w_/ . As 
shown in Fig. 3, at each pyramid level E of frames I t -i and I t , the motion field d' +1 is propagated 
from the coarser level E +1 and used as an initial guess for the motion field. Given that initial guess, 
the refined motion field is computed by the iterative motion estimation, and the result is propagated 

-2- Serial No. 10/748,371 



to the next finer level L' 1 , and so on to level L° , which represents the original frame. The final 
result d° is the desired motion field between frames I t -i and I t . 

[0021] The difference In one embodiment, to the coarse to fine strategy used in pyramidal the 
motion estimation algorithm described in the last section is that also passes the motion field is passed 
within the each level of the image pyramid , not from coarse to finer levels . As shown in Fig. 4, at 
level L' , the coarse motion field d' +1 of level Z,' +/ is propagated and used as an initial guess d 1 ' for 
the motion field. Frame V t _, is then warped to l' t '_j by the initial guess d 1 ' . Using the HS algorithm, 
the residual motion r between warped frame l' t '_j and frame is determined, and added to the initial 

guess d 1 ' as a refinement. The refined motion field is then used as initial guess again. The 
procedures of warping frame, the HS motion estimation, the motion field refining are carried out 
recursively, until the norm of the residual motion field r is less than a predefined threshold R t h re , or 
the iterative number n is more than a predefined threshold AW The final result of the motion field at 
level L! is propagated to next finer level U ' as the initial guess of that level according to the 
pyramidal motion estimation algorithm described in last section. 

[0022] The above described motion estimation method combines the iterated registration method 
with the pyramidal motion estimation method. This method, hereafter referred as iterative pyramidal 
motion estimation (IPME), has two major advantages. Firstly, a lesser number of levels in the image 
pyramid will be needed since larger motion at each level can now be tracked. Secondly, the coarse 
motion estimation errors propagated to the finer levels can be recovered. At the same time, IPME 
algorithm has faster convergence property than that of the HS algorithm, and it is more efficient than 
the HS algorithm. 

[0023] After the motion estimation stage between frames I t _, and I t is completed , a dense and 
accurate motion field d, which is the final result of motion field d° at level L°, is obtained determined . 
With the motion vectors in the motion field d, a matching pixel in frame I t is found for each pixel in 
frame I t _, . Then, along the motion trajectory, the matched pixels pair is moved to a proper pixel 
location on the intermediate frame I int as shown in Fig. 5. In Fig. 5, A. is a parameter representing the 
location on the motion trajectory from frame I t , to frame [m -fp, where X ranges from 0 (at a 
corresponding pixel location in frame I t , ) to 1 (at a corresponding pixel location in frame I t ). 
Thus, a motion vector is assigned that pixel location on the frame I int . 
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